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Abstract 

A saturated D-optimal design is a {+1,-1} square matrix of given 
order with maximal determinant. We search for saturated D-optimal 
designs of orders 19 and 37, and find that known matrices due to 
Smith, Cohn, Orrick and Solomon are optimal. For order 19 we find all 
inequivalent saturated D-optimal designs with maximal determinant, 
230 X 7^ X 17, and confirm that the three known designs comprise a 
complete set. For order 37 we prove that the maximal determinant 
is 2"^^ X 3'^^, and find a sample of inequivalent saturated D-optimal 
designs. Our method is an extension of that used by Orrick to resolve 
the previously smallest unknown order of 15; and by Chadjipantelis, 
Kounias and Moyssiadis to resolve orders 17 and 21. The method is a 
two-step computation which first searches for candidate Gram matrices 
and then attempts to decompose them. Using a similar method, we 
also find the complete spectrum of determinant values for {+1,-1} 
matrices of order 13. 



1 Introduction 

The Maximal Determinant problem of Hadamard \12\ [22] asks for the largest 
possible determinant of an n x n matrix whose entries are drawn from the set 
{-|-1, — 1}. We are only interested in the absolute value of the determinant, 
since we can always change the sign of the determinant by changing the sign 
of a row. The problem in its full generality has been open since first posed by 
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Hadamard [12], and has applications to areas such as Experimental Design 
and Coding Theory. 

We could equally well consider {0, 1} matrices. There is a well-known 
mapping [25j from {0, matrices to {+1, —1}"-^" matrices which 

multiplies the determinant by (—2)"^^, and vice versa. To avoid confusion 
we only consider {+1, —1} matrices. Their determinants are always divisible 
by 2"'~^ , thanks to the correspondence with {0,1} matrices. Thus, it is 
convenient to let Dn denote max| det(i?)|, where the maximum is over all 
{+1, -1}"X" matrices R, and = L>„/2"-i. 

There is an extensive literature on the Maximal Determinant problem, 
which splits into four cases, according to the value of n mod 4. A general 
upper bound of 

Da < n^/^ (1) 

on the maximal determinant applies to all the four cases, but is not achiev- 
able unless n = 1,2, or n = mod 4. The conjecture that this bound is 
always achievable when n = (mod 4) is known as the Hadamard Conjec- 
ture, and has been the subject of much investigation, see for example |lHll3j. 
Smaller upper bounds are known for each of the other three equivalence 
classes modulo four. 

A bound which holds for all odd orders, and which is known to be sharp 
for an infinite sequence of orders congruent to 1 (mod 4) , is 

Dn < v/(n-l)"-i(2n-l), (2) 

due independently to Ehlich [9] and Barba [1]. A smaller upper bound, due 
to Ehlich |1U] , applies only in the case n = 3 (mod 4) : 

Dn<^{n- 3)"-^(n - 3 + 4r)«(n + 1 + 4r)- (l - - ^jjj^ . 

(3) 

Here s = 3 for n = 3 (and the factor (n — 3)^"" is interpreted as 1 in this 
case), s = 5 for n = 7, s = 6 for 11 < n < 59, s = 7 for n > 63, r = \n/ s\ , 
V = n — rs, and u = s — v. The complicated form of the bound ([3]) as 
compared with ([2]) is indicative of the extra difficulties which often seem to 
arise when re = 3 (mod 4). The bound ^ is sharp when n = 3; it is not 
known if it is sharp for any n > 3. 

In this work we settle the smallest hitherto unresolved case of n = 19. 
This case has remained open despite higher orders (for example, 21) being 
solved by similar methods, mainly because the use of ([2]) and its generali- 
sation when the Gram matrix has a fixed block — see Theorem [T] — is much 
more eff'ective in pruning the search tree than are Q and its generalisations. 
All orders congruent to 3 mod 4 and larger than 19 are currently open. 

In this paper we only consider odd orders. The smallest unresolved 
orders which are congruent to 1 mod 4 are n = 29, 33 and 37. Of these, 
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we resolve n = 37, and improve the upper bounds for n = 29, 33. For a 
summary, see Table 1 in ^ 

Our method is structurally similar to that used for n = 15 by Orrick |18) . 
and by earlier authors for n = 17 in jlT] and n = 21 in [3]. There are two 
essential steps. Gram finding and decomposition. In the cases we consider, 
decomposition by hand would be tedious for n = 19, and infeasible for 
larger orders. Thus, we implement a back-tracking computer search to deal 
with this second step, describing such an algorithm for the first time in the 
literature. 

Our Gram-finding algorithm is discussed in ^ and our decomposition 
algorithms in ^ The results for order 19 are described in ^ and for 
order 37 in ^ In ^we give some new upper and lower bounds for various 
odd orders. For orders n = 29, 33, 45, 49, 53 and 57 we have not been able 
to determine Dn precisely, but we have reduced the gap between the known 
upper and lower bounds. Finally, in ^we also find the complete spectrum 
of determinant values for {+1,-1} matrices of order 13. Previously, the 
spectrum was only known for orders up to 11. 

2 Definitions 

Z denotes the integers, and Ni the positive integers. The following defi- 
nitions are largely taken from [18j, to which we refer for further technical 
definitions. 

Definition 1. A design is an mx n matrix with entries drawn from the set 
{+1,-1}. If m = n the design is called saturated. // the absolute value of 
the determinant of the saturated design is maximal for its order, the design 
is called D-optimal. 

In this paper we consider saturated D-optimal designs of odd order. It is 
convenient to consider "normalized" designs, leading to the next definition: 

Definition 2. A vector with elements in {+1, —1} is parity normalized iff 
it has an even number of positive elements. A design is parity normalized 
iff all its rows and columns are parity normalized. 

It is easy to show, as in [9^ Lemmas 3.1, 3.2], that any saturated design 
of odd order can be converted to a unique parity normalized matrix by a 
series of negations of rows and columns. 

If Ri is a design, then any signed permutation of the rows and columns 
of i?i gives another design R2, which we can regard as equivalent to the 
original design since |det(i?i)| = |det(i?2)|- We can also change the signs 
of any rows and/or columns of without changing more than the sign of 
the determinant. This suggests the following definition, in which a signed 
permutation matrix is a permutation of the rows or columns of a diagonal 
matrix diag(ibl, ±1, . . . , ±1). 
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Definition 3. Two designs R and S are Hadamard equivalent iff S = PRQ 
for some pair of signed permutation matrices {P,Q). 

Definition 4. If R is a design, then G = RRF is called the Gram matrix 
of R, and H = R^R is called the dual Gram matrix of R. 

Definition 5. Two symmetric matrices Gi and G2 are Gram equivalent iff 
Gi = PG2P^ for some signed permutation matrix P. 

Definition 6. Let dmin > o,n^d let M.n,p be the set of square matrices M, 
of order p, 1 < p < n, satisfying properties 1-3 below. 

1. M is symmetric and positive definite; 

2. Mi^i = n; 

3. Mi J = n (mod 4). 

A matrix M G Ain,p is called a candidate principal minor. //, further- 
more, n = p and the following additional properties 4-5 hold: 

4. det(M) = for d G Z; 

5. d ^ djYiini 



then M is called a candidate Gram matrix. 

It is clear that Properties 1, 2, 4 and 5 of candidate Gram matrices are 
satisfied by all Gram matrices. Furthermore, Property 3 of candidate Gram 
matrices holds for Gram matrices G = RRF if R is assumed to be parity 
normalized. 
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3 Gram-finding Algorithm 



We summarize our Gram-finding algorithm below. The method is essentially 
that described in greater detail in |18j . We search for candidate Gram 
matrices whose determinant is greater than or equal to a positive parameter 



1. Set r = 1 and start from the candidate principal minor Mi 



in 



2. Increment r. Build a list of admissible vectors /, and allowable vec- 
tors 7 (for details see [T8|). 

3. For each possible lexicographically maximal matrix Mj—i of order r— 1, 
and each admissible vector /, construct the matrix 



Mr 



Mr-l 



(4) 



If r = n, 

(a) ifdet(Mr 
If r < n, 

(b) evaluate 



d'^ ^ ^min' output the candidate Gram matrix Mj. 



d 



Mr 7 

7^ 1 



(5) 



for each allowable vector 7, looking for a "good d", namely d 
such that the function Ur in Theorem [T] satisfies Ur{l,d) > d^j^. 
If a good d is found, try to extend by recursively calling the 
algorithm (starting at step [2]). 

Pruning at step[3l^b) of the above algorithm relies on the following Theo- 
rem, originally used by Moyssiadis and Kounias [T7] to find a maximal Gram 
matrix of order n = 17. Our version below contains a sharper bound Q 
applicable when n = 3 (mod 4). 
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Theorem 1. [Enhanced Kounias & Moyssiadis] Let M 



be a 



Mr B 

A 

symmetric, positive definite matrix of order n with elements taken from a set 
$ whose members are greater than or equal in magnitude to some number 
c, < c < n. Here Mr is a candidate principal minor of order r < n, and 
A is a square matrix of order n — r, with diagonal elements Ai^i = n. The 
columns of the r x [n — r) matrix B are taken from some set C Define 
d* and 7* by 



d* 



Mr 
7*^ 



7^ 
c 



max 



Mr 
T 

7 



Then 



where 



det(M) < Ur{c,d*), 



(6) 
(7) 



Ur{c, d) = {n- c)""''"^ [(n - c) det(Mr) + (n - r) max(0, d)] . 

Furthermore, if n = 3 (mod 4), then the following bounds apply: 

det(M) < (n- l)"-'^det(M^) + (8) 
[(n - l)"-"^ - (n - 3)"-'' - (n - r)(n - S)"-'-^] max(0, d*) 

and, assuming det Mr > (n — 3) det Mr-i, 



det 



max max 

k f)i,...,fefeG 
bi+...+bk = 


max 

Nl 7j,...,7*gr^ 
n—r 




Mr 










[n — 


3)/6i + SJfci • • • 


~'^bi,bk 








(n - 3)Ib^ + 3Jb^ 



(9) 



where Mr-i is the principal (r — l)-by-{r — 1) minor of Mr, ja is the column 
vector of dimension a whose elements all equal 1, Ja^b is the a-by-b matrix 
whose elements all equal 1, and Ja = Ja,a- 

Proof. For a proof of inequahties ([7]) and ([8]) we refer to [181 Theorem 3.1 
and Corollary 3.3]. A proof of ([9|) is sketched in the Appendix. □ 

The bound ([9]) is sharp and therefore potentially much more powerful 
than ([7|) or ([8]). Unfortunately, the multidimensional search for the optimal 
set of block sizes (61, ... , bk), and the optimal set of vectors, {"fj} is expen- 
sive. We therefore restricted its use to the situation where the non-diagonal 
elements of the last column of Mr all equal —1. This allows us to assume 
that all 7* consist entirely of elements —1, and we are left only with the 
search for the optimal partition. Much of the computation associated with 
the latter search need only be done once. The use of ([9]) resulted in an 
approximately 15% improvement in running time. 
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4 Decomposition Algorithm 



The output of the program described m the previous section is a Hst £ 
of candidate Gram matrices, complete in the sense that it contains one 
representative of each Gram equivalence class with determinant > d^^^ for 
a given bound dmm- We need to determine if any G £ JC decomposes as 
a product G = RR^ for some square {+1,-1} matrix R. This section 
describes several algorithms for carrying out this task. 

For each candidate G this involves a (possibly large) combinatorial search. 
It may be regarded as searching a tree, where each level of the tree corre- 
sponds to one row of the matrix R. At level k we know k — 1 rows of R and 
try to find a A;-th row satisfying the constraints. Each node at the A;-th level 
corresponds to one possible choice of the A:-th row of i?, given the preceding 
rows. If G = RlC^ has solutions, then the solution matrices, i?, correspond 
to nodes at level n of the tree. In principle our procedure may generate 
many Hadamard-equivalent solutions. We prune the tree so as to limit the 
number of duplicate solutions produced. 

The search algorithm relies on a family of constraints. The zeroth mem- 
ber of the family is a special case which can be implemented with a single 
Gram matrix and we call this constraint the single- Gram constraint. The 
rest of the family require both the Gram matrix G = RR^ and the dual 
Gram matrix H = R^R and we call these Gram-pair constraints. 



Our decomposition algorithm differs from that described in [i^ in several 

respects. First, it builds up R by rows, instead of by rows and columns 
simultaneously. Second, it uses more general Gram-pair constraints (see (fH|) 
with J > 2 below). 

For clarity, we first describe a version of the algorithm which uses only 
the single-Gram constraint. 

4.1 Decomposition using only the single-Gram constraint 

Denote the elements of G by gij for i,j = 1, ..,n, and the rows of R by 
for i = 1, . . . , n. Then the constraint RR^ = G is equivalent to 



for 1 < i < J < n. The search tree is created by application of these 
constraints. An outline of the basic algorithm is as follows. The main work 
is done by a recursive procedure search(fc) which searches an (implicit) 
subtree at level k, where the root is at level 1. 





9i,j 



(10) 
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Algorithm using the single-Gram constraint, version 1 

1. Initialize level k = 1, first row ri = (1, 1, . . . , 1) and R = ri. 

2. Call search(A;). 

3. Output "no solution" and halt. 

4. search(A;): If k = n, output the solution R and halt. Otherwise incre- 
ment k. Find all solutions G {+1,-1}" of the (under-determined) 
set of simultaneous linear equations: 



ri 




9i,k 




T 


92,k 




= 








_9k-l,k_ 



For each solution r^, append to R and call search(A;) recursively 
to search the relevant subtree. Return to the caller (i.e. backtrack). 

We justify the choice of the first row in the above algorithm by observing 
that G = RR^ is invariant under a signed permutation of columns of R, i.e. 
R 1— >• RP for any signed permutation matrix P. 

The above algorithm considers a large number of equivalent partial so- 
lution matrices R, and is impractical for all but very small orders. We can 
obtain a vastly more efficient algorithm by imposing an ordering constraint 
on the +l's and — I's in row-vectors. We do this by defining the concept 
of "framings" and a new set of associated variables called "frame variables" 
which we use in Step S] instead of r^. We first define these terms, and then 
give an improved version of the algorithm. 

At each level k, we create a partition of the indices {1, . . . , n} into frames, 
where a frame is a nonempty contiguous set of indices; and the collection 
of frames is called a framing. A framing of size m is defined by a frame- 
widths vector w = {wi, . . . ,Wm) £ N™, ^ = n, where Wi is the size of 
the i-th frame. At level 1 the framing consists of a single frame {1, . . . ,n} 
with frame- width vector w = (n). At each subsequent level, the framing 
is a refinement of the framing from the previous level. We use the framing 
at level /c — 1 to define the frame variables that we use at level k in the 
following algorithm. The frame variable Xi gives the number of +1 entries 
in the A;-th row of R, considering only the column indices given by the i-th 
frame. Thus, the number of —1 entries is vui — Xi and the sum of the entries 
is 2xi — Wi (see equation ([IT]) ). 
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Algorithm using the single-Gram constraint, version 2 



1. Initialize the level k = 1, the frame-size m = 1 and the frame-width- 
vector w = (wi) = (n). Set qi = (+1) and Q = qi. [In the course 
of the algorithm, qi is a column vector of size A; — 1 or A;, and Q is a 
matrix whose columns depend on the g^. Also, w may be thought of 
as a vector of weights corresponding to the columns of Q.] 

2. Call search(fc). 

3. Output "no solution" and halt. 

4. search(A;): If A; = n, output the solution Q and halt [here m = n]. 
Otherwise increment k. 

Define integer variables xi,X2, ■ ■ ■ ,Xm- Find all solutions to the fol- 
lowing integer programming problem: 



" 2x1 


— VUl 




9i,k 


2X2 


- W2 




92,k 








_gk-l,k_ 



Q 



subject to 

< Xi < Wi for 1 < i < m. 
For each solution, update w and Q as follows: 



(11) 



(12) 



(a) Let W := {xi,Wi - Xi, X2,W2 - X2, Xm,Wm - Xm)- 

(b) Recall that Q = {qi,q2, ■■■,qm) is a matrix of column vectors qi, 
each of length k — 1. Update Q to a k x 2m matrix as follows: 



Q:-- 



+1 



-1 +1 



Q2 



Qm Qm 
+ 1 -1 



(c) Compress Q by removing all columns which correspond to zeros 
in w. 

(d) Compress w by removing all zero entries. 

(e) Set m := length(u;). 

Call search(A:) recursively to search the relevant subtree. When all 
solutions have been processed, return to the caller (i.e. backtrack). 

In procedure search(A:) of version 2 we use Gaussian elimination with col- 
umn pivoting in order to find a (A; — 1) x (A; — 1) nonsingular minor of Q 
(this is always possible, since the Gram matrix G is positive definite). We 
then solve for the corresponding k — 1 basic variables in terms of the re- 
maining m — A: + 1 non-basic variables. The non-basic variables are chosen 
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exhaustively as integers in the appropriate intervals given by ()12p : the basic 
variables are then determined uniquely (as real numbers). If the non-basic 
variables are not in Z or violate the bounds ()12p . the solution is discarded. 
It is preferable to choose as non-basic variables the variables with the small- 
est upper bounds Wi, provided that the resulting {k — 1) x (k — 1) minor is 
nonsingular. A heuristic for accomplishing this is to weight the columns in 
proportion to the bounds Wi before performing the Gaussian elimination. 

We illustrate an iteration of the algorithm with an example. Consider 
the case n = 7 and the candidate Gram matrix (here and elsewhere we may 
abbreviate by "-"): 



7 3 
3 7 



G 



7 
3 



7 
3 



3 
7 



------ 7, 

Suppose we are at level A: = 3 in the search. At this stage the search 
tree has not branched yet, so there is just one matrix Q: 



Q 



1 1 
1 1 - 
1 - 1 



1 1 



Associated with Q is the frame-widths vector (at depth 3) which is 

= (2,3,1,1). 

We comment that, translated into the language of the algorithm in version 1, 
Q and w together correspond to a 3 x 7 matrix R: 







"1 


1 


1 


1 


1 


1 1 






1 


1 


1 


1 


1 








1 


1 








1 - 



To find the next row of Q, we define 4:{= m = \w\) new variables xi, X2, X3, X4. 
The interpretation is that xi represents the number of "+l"s in the first 
wi = 2 entries of row 4, X2 represents the number of "+l"s in the next 
W2 = 2> entries of row 4, as so on. We use the constraints imposed by 
51,4,52,4,93,4, giving the linear system 



1 1 



2x1 - 2' 
2x2-3 
2x3-1 
2X4 - 1 
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The two integer solutions which satisfy this system as weh as the bounds 
< xi < 2, < X2 < 3, < X3 < 1, < 2:4 < 1 given by equation (fT2]) are 
{xi, X2, X3, X4^) = (1,1,1,0) and (2,0,0,1). These generate two children in 
the search tree, with Q and w as follows: 



Q 



1 1 

1 - 
1 - 



with w = (1,1,1,2,1,1); 



and 



Q 



1111 
11-- 
1 - 1 - 
1 - - 1 



with w = (2,3,1,1) 



The first Q leads to a solution; the second does not. 



4.2 Decomposition using Gram-pair constraints 

The algorithm (version 2) outlined in ^4.H using only the single-Gram con- 
straint, quickly becomes infeasible due to the size of the search space. It 
can be improved by noting that, since the list C is complete, it must include 
a matrix H Gram-equivalent to R^R. By permuting columns of R, we can 
assume that H = R^R. This relation allows us to prune the search more 
efficiently than if we did not know H. 

Recall that the characteristic polynomial of a square matrix A is the 
monic polynomial P{X) = det(A/— ^). Since H = R^G{R^)~^, the matrices 
G and H are similar, so they have the same characteristic polynomial. 

Thus, the refined strategy is to consider each pair (G, H) e such that 
G and H have the same characteristic polynomial, and try to find R such 
that G = RR^, H = R^R. If we have considered {G, H) there is no need 
to consider {H, G) since this would correspond to the dual solution R^ . 

More precisely, consider the constraint 

G^+i = {RR^y+^ = R{R^RyR^ = RWR^. (13) 

We say that the degree of such a constraint is j + 1, since the elements of 
G (not R) occur with degree j + 1. The case j = corresponds to the 
single-Gram constraint considered in ^4.11 For j = 1 we get the degree 2 
constraint 

= RHR^ 

considered in [18]. The use of Gram-pair constraints with j > 1 is a new 
element of our algorithm. In principle, we could get different constraints for 
J = 0, 1, . . . , n — 1. For j > n the Cayley-Hamilton theorem implies that we 
get nothing new. 
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To apply Gram-pair constraints for pruning when only the first k — 1 rows 
of R are known, partition the matrices appearing in (jl3p into corresponding 
blocks: 



R 



Ri 
R2 



'Gi,i{j + 1) 
G2Aj + l) 



Gl,2(j + 1) 
G2,2(j + 1) 



H2M 



say, where Ri has k — 1 (known) rows. Then we can use the constraints 

G,Aj + l) = RiH,Aj)Rj (14) 

since it only involves the known rows of R. The matrices G^^^ and need 
only be computed once. 

Observe that Hi^j) for j > 2 depends on all the entries in H. This 
suggests that (jl4p with j > 2 may be more effective for pruning than the 
"degree 2" case j = 1. In practice, we found that it was worthwhile to 
use (fH|) with both j = 1 and j = 2, but not with j > 2. 

When using Gram-pair constraints for pruning, we can no longer assume 
that the first row of ii is (1, 1, ... , 1). The algorithm (version 2) of ^4.11 has 
to be modified so step 1 starts with level /c = 0, Q empty, and a frame- widths 
vector w which is compatible with iJ, in the sense that H is invariant under 
permutations of rows (and corresponding columns) within each frame. For 
example, if we take H = G m. the example of order 7 above, we can choose 
w = (2, 2, 2, 1) as the initial frame-widths vector. 

We remark that we used three variants of the decomposition algorithm 
outlined in this subsection. One variant attempts to find a decomposition 
or (by failing to do so) to prove that a decomposition of a given pair (G, H) 
does not exist. A second variant finds all possible decompositions, up to 
Hadamard equivalence. The output typically includes many solutions that 
are Hadamard equivalent, so we use McKay's program nauty [T5] to remove 
all but one representative of each equivalence class after transforming the 
problem to a graph isomorphism problem [H]. A third variant is nondeter- 
ministic and attempts to traverse the search tree by choosing one or more 
children randomly at each node. This variant is useful in difficult cases 
where the deterministic variants take too long (see ^6.21 for an example) . 



4.3 Proving indecomposability using the Hasse— Minkowski 
criterion 

A complementary approach to the decomposition problem, or, more prop- 
erly, to proofs of indecomposability, makes use of the Hasse-Minkowski the- 
orem on rational equivalence of quadratic forms. The use of this theorem 
has a long history in design theory, originating with its use by Bruck and 
Ryser in their proof of their nonexistence result for certain finite projective 
planes f3]. Tamura recently applied the theorem to the question of decom- 
posability of candidate Gram matrices with block structure [2Zj . 
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Theorem 2. Let A and B he symmetric, nonsingular rational matrices 
of the same dimension. Then there exists a rational matrix R such that 
B = RAR^ if and only if 

1. det A/det B is a rational square, and 

2. the p- signatures of A and B agree for all primes p and for p = —1. 

The criterion is implemented by finding rational matrices U and V such 
that UAU^ and VBV^ are diagonal — this can always be done — and then by 
comparing the p-signatures of the resulting matrices for all primes dividing 
any of the diagonal elements. The p-signature of a diagonal form is defined 
in [3 Chapter 15, §5.1]. 

The application of this theorem is as follows: there is no decomposition 
of the form RR'^ = G, R^R = H if there is a j > for which G^+^ fails to be 
rationally equivalent to or for which H^^^ fails to be rationally equivalent 
to . As was the case in the application of the Gram-pair constraint in 
back-tracking search, we need only check the criterion for j < n. 

The Hasse-Minkowski criterion is sometimes a competitive alternative 
to the backtracking algorithm in ruling out the existence of a decomposition. 
On certain Gram matrix pairs for which the back-tracking search ruled out 
a decomposition only after exploring the search tree to great depth, the 
Hasse-Minkowski criterion ruled out any decomposition with a relatively 
fast computation. In most cases, however, back-tracking search is the much 
faster method, especially when rational equivalence fails only for large j, 
in which case the large-integer arithmetic needed to implement the Hasse- 
Minkowski criterion can become prohibitively expensive. Furthermore, in a 
small number of cases, the Hasse-Minkowski theorem fails entirely to rule 
out a decomposition where backtracking search succeeds. It is surprising 
that this occurs relatively infrequently, as the existence of a decomposition 
with R rational would appear to be a far milder constraint than the existence 
of a decomposition with R a {+1,-1} matrix. 

5 The Maximal Determinant for Order 19 

For order 19, known designs due to Smith j26j , Cohn [6j and Orrick and 
Solomon |24) are D-optimal, as we now show. 

Theorem 3. The maximal determinant o/{+l,— 1} order 19 matrices is 

2^° X 7^ X 17 = 833 x 4^ x 2^^ (15) 

There are precisely three corresponding equivalence classes of saturated D- 
optimal designs with representatives Ri , R2 and R3 indicated in Figure [H 
There are two corresponding (Gram equivalence classes of) Gram matrices, 
G\ = R\R^ = Rf Ri and G2 = R2R2 ~ R2R2 — RsR^ — R^Rs ~ see 
Figure Ui 
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Proof. A computational proof of Theorem [3] is described in S ^5.1f[5?2l □ 

Remark 1. The maximal determinant given by (|15p is smaller by a factor 
17/^304 ^ 0.975 than the Ehlich bound Q /orn = 19. 

5.1 Candidate Gram-finding for order 19 

In the algorithm described in ^we used dmin = 833 x 4^ x 2^^ since {+1, —1} 
matrices with this determinant were known to exist. Our candidate Gram- 
finding program took 826 hour^l to find nine equivalence classes of candidate 
Gram matrices and to rule out any others. 

For the nine candidate Gram matrices G, the values of ydet(G)/2^^ 
were 840 (five times), 836.0625 (once), 836 (once), and 833 (twice). The 
matrices are available from the website [2]. 



Gi 



3 3 3 



n 3 3 
3 n 3 
3 3 n 



n 3 
3 n 



3 3 n 

— — — n 3 3 

— — — 3 n 3 

— — — 3 3 n - 



Go 



n 3 3 3 



n 3 3 
3 n 3 
3 3 n 



n 3 
3 n 
3 3 



3 3 

n 3 — — 
3 n — — 



Figure 1: Optimal Gram matrices for n = 19. Here "— " stands for "—1". 

^ Computer times mentioned here and below are for a single 2.3GHz Opteron processor. 
In cases where the search could easily be parallelised, we sometimes used several processors 
running in parallel. Our candidate Gram-finding program actually took 188 hours using 
several processors, each operating on part of the search tree. Our programs were written 
in C and used the GMP package to perform multiple-precision arithmetic. 
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5.2 Decomposition for order 19 

Our decomposition program found that seven of the candidate Gram matri- 
ces were indecomposable, but the last two decomposed (as expected). The 
running time was only 0.85 sec. Nevertheless, it would be extremely tedious 
to attempt to replicate the search by hand, since it involves visiting about 
1400 nodes in the search trees. 

The nine matrices have distinct characteristic polynomials, so we only 
had to consider the case G = RR^ = H = R^R. Only the two candidate 
Gram matrices with smallest determinant were decomposable, and these de- 
composed in three ways, giving three Hadamard classes of designs (maxdet 
matrices) of order 19. See Figured] for the Gram matrices (note that they 
differ only in the first row and column) , and Figure [5] for two of the three 
designs. The third design R^ can be obtained from R2 by a switching oper- 
ation, as indicated in Figure [2j 

A variant of our decomposition program exhaustively searches for all 
possible decompositions (up to equivalence) of a given pair {G,H). Run- 
ning this program on (Gi,Gi) gave 110592 matrices in 36 seconds. Using 
McKay's program nauty |14l I15j . we verified that they were all equivalent 
to Ri. Similarly, on (^2,^2) we obtained 3456 matrices in 3 seconds, and 
nauty verified that 1728 were equivalent to R2, and the remaining 1728 were 
equivalent to R3. Thus, there are precisely three inequivalent designs with 
maximal determinant. 



6 The Maximal Determinant for Order 37 

The case of order 37 was handled in much the same way as order 19. Al- 
though 37 is much larger than 19, we have 37 = 1 mod 4, and typically the 
cases 1 mod 4 are easier than the cases 3 mod 4 (as one can see from the 
summary at [22|). This is partly because Theorem [1] gives a sharper bound 
when n = 1 mod 4. 

We established that, for order 37, a known design, found previously by 
Orrick and Solomon [2Tj, is D-optimal. The design is not unique, but the 
corresponding Gram matrix is (up to equivalence). 

Theorem 4. The maximal determinant o/{-|-l,— 1} order 37 matrices is 

72 X 9^^ X 2^^ = 2^9 X 3^^ (16) 

A representative R of one equivalence class of saturated D-optimal designs is 
indicated in Figure^ The corresponding Gram matrix is G = RR^ = R^R 
as shown in Figure\^ Moreover, G is unique, up to equivalence. 
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Figure 2: Two inequivalent saturated D-optimal designs of order 19. Here 
"— " stands for "—1" and "+" stands for "+1". A third inequivalent design 
R3 is the same as R2 except that the circled entries have their signs reversed 
(this is an example of "switching", see Orrick [IBj)- 
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Remark 2. The maximal determinant given by (|16p is smaller by a factor 
8/VT3 ^ 0.936 than the Ehlich-Barba bound ^ for n = 37. 



G 



"37 5555555551 
5 37 111111111 
51 37 11111111 
511 37 1111111 
5111 37 111111 
51111 37 11111 
511111 37 1111 
5111111 37 111 
51111111 37 11 
511111111 37 1 
1111111111 37 



1 
1 
1 
1 
1 
1 
1 
1 
1 
1 
1 



.11111111111 



37j 



Figure 3: The optimal Gram matrix for n = 37. All omitted entries are 1. 



The matrix R in Figure U] was constructed by Orrick and Solomon from 
a doubly 3-normalized Hadamard matrix of order 36. There are at least 78 
(and probably many more) inequivalent designs, as we discuss below. 

6.1 Candidate Gram matrices for order 37 

Our backtracking program with bound dmin = 23^336 (93.6% of the Ehlich- 
Barba bound) took 77 hours to find 807 candidate Gram matrices. These 
had 284 distinct determinants in the range A/(2^^3^^) G [81,85]. The 
candidate Gram matrices are available from the website [2]. 

6.2 Decomposition for order 37 

We applied our decomposition program to all pairs (G, H) of candidate 
Gram matrices where G and H had the same characteristic polynomial. 
There were 489 different characteristic polynomials, and 1528 pairs (G, H) 
to consider. The decomposition algorithm took 257 seconds to show that 
806 of the candidate Gram matrices did not decompose (in no case could 
more than two rows of R be constructed) . 

For the remaining candidate, which was in fact equivalent to the Gram 
matrix G shown in Figure [3l the program was stopped after running for 147 
hours and exploring about 1.7 x 10^ nodes (reaching level 26 of the tree). 

A variant of our decomposition program uses a randomised search - at 
each node of the tree being searched, we choose to explore one (or sometimes 
two) children selected uniformly at random. Using this randomised search 
program we can decompose G, in fact we have now found 39 solutions. 
Finding one solution takes on average about 125 hours. By also considering 
duals, we get 78 solutions. Some (but not all) of these can be obtained 
from a Hadamard matrix of order 36, in the same way as the matrix R 
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of Figure [H Since all 78 solutions are inequivalent, we expect that many 
more inequivalent solutions exist. The known solutions are available from 
the website [2] • 




Figure 4: A saturated D-optimal design of order 37, constructed by Orrick 
and Solomon. Here "-" stands for and "+" stands for 



7 Improved Bounds for Various Orders 

Recall that dn is the maximal determinant for order n, divided by the known 
factor 2""'^. Table 1 summarises the best known upper and lower bounds on 
dn for orders n = 19, 29, 33, 37, 45, 49, 53, 57 (we omit n = 25, 41, 61 because 
for these orders the Ehlich-Barba bound ([2]) is attained). The figures in 
parentheses are the ratios of the entries to the Ehlich-Barba bound (for 
n = 1 mod 4) or the Ehlich bound (for n = 3 mod 4), rounded to three 
decimals. 

For n = 19 and n = 37, the upper and lower bounds are equal, and thus 
optimal {dn = u = i in these cases). In the other cases the upper bounds 
are unattainable, so dn G "u). In all cases the upper bounds are new. 
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and for n = 45 the lower bound is new (the previous best lower bound was 
83 X ll^i). 

The last column gives the number of equivalence classes of candidate 
Gram matrices G with det(G) > (2"~-^n)^. 



order n 


lower bound i 


upper bound u 


Gram count 


19 


833 X 46 


(0.975) 


833 X 46 


(0.975) 


9 


29 


320 X 7^2 


(0.865) 


329 X 7^2 


(0.889) 


9587 


33 


441 X 8^^ 


(0.855) 


470 X 8^4 


(0.911) 


13670 


37 


8 X 9^^ 


(0.936) 


8 X 9I® 


(0.936) 


807 


45 


89 X 11^1 


(0.858) 


99 X ll2i 


(0.953) 


1495 


49 


96 X 12^3 


(0.812) 


114 X 12^3 


(0.965) 


168 


53 


105 X 13^5 


(0.788) 


129 X 13^5 


(0.968) 


220 


57 


133 X 1427 


(0.894) 


145 X 1427 


(0.974) 


128 



Table 1: Bounds on the (scaled) maximal determinant d, 



7.1 Discussion 

Let k = [n/4j. From the summary at [22] we observe that, in the cases 
k < 3 where ^4^+3 is known precisely, ^4^+3 is divisible by k'^^~^ . However, 
our result for n = 19 shows that this pattern does not continue, for dig is 
not divisible by 4''. 

In all cases where ^4^+1 is known precisely (fc < 6 and k = 10, 15, 28, . . .), 
dik+i is divisible by k'^^~^ . This is easily seen to be true if the Ehlich-Barba 
bound ([2]) is attainable {d^kj^i is divisible by k'^^ in such cases), but it is also 
true for A; = 2, 4, 5, where the Ehlich-Barba bound is not attainable. 

For n = 29, we ruled out 9587 candidate Gram matrices to show that 
^29 < 329x7^2. If ^29 is divisible by 7^^^ then we must have = 322x7^^ = 
46 X 7^3^ since this is the only multiple of 7^^ in the allowable interval 
[320x7^^, 329x7^^). However, all attempts to construct an example of order 
29 with I det \/2'^^ > 320 x 7^^^ using hill-climbing or constructions based on 
Hadamard matrices of order 28, have failed. Thus, the plausible conjecture 
that ^4^4.1 is divisible by /c^*^~^ may well be false. An attempt to reduce the 
upper bound u to 322 x 7^^ is underway but may not be feasible with our 
current resources - so far we have generated 16683 candidate Gram matrices 
(taking about two processor-years) but estimate that there are about 220000 
in all. 

For n = 33 we ruled out 13670 candidate Gram matrices to establish an 
upper bound of u = 470 x 8^^. It is unlikely that we can reduce u much 
further without improvements in the candidate Gram-finding program, since 
it took about two processor-years to generate the candidates for u = 470, 
though only about six hours to show that none of them decompose. 
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For n = 4:5, the new lower bound of 89 x 11 was established by a 
construction using a doubly 3-normalized Hadamard matrix of order 44. 
Details will appear elsewhere. 

8 The Spectrum for Order 13 

The spectrum 5„ of the determinant function for {+1,-1} matrices is de- 
fined to be the set of values taken by | det(i?„)|/2"~^ as Rn ranges over 
all n X n {+1,-1} matrices. For 2 < n < 7, the spectrum includes all 
integers between and The spectrum for n = 8 was first computed 
by Metropolis, Stein, and Wells [16], who found that gaps occur, in fact 
= {0, 1, . . . , 18, 20, 24, 32}. A (non-computer-based) proof of the exis- 
tence of gaps was later given by Craigen [8j. At present, the spectrum is 
known for n < 11 and (given here for the first time) for n = 13. The results 
for n = 9 are due to Zivkovic [28] (and, independently, Charalambides [5]), 
those for n = 10 are due to Zivkovic [2H], and those for n = 11 are due to 
Orrick [18j. The spectra for n < 11, and conjectured spectra for n = 12 
and 14 < n < 17, may be found at [23]. Here we give only the spectrum 
for n = 13, using the notation a..b as a shorthand to represent the interval 
{x eZ:a<x <b}. 

Theorem 5. The spectrum for order 13 is 

5i3 = {0..2172, 2174. .2185, 2187.. 2196, 2199.. 2202, 2205, 2208, 2210, 2211, 
2214.. 2218, 2220. .2226, 2228, 2229, 2230, 2232, 2233, 2235, 2238, 2240, 2241, 
2243. .2245, 2247, 2248, 2250, 2253, 2256, 2258.. 2260, 2262, 2264, 2265, 2267, 
2268, 2271, 2272, 2274, 2277, 2280, 2283, 2286, 2288, 2292, 2295, 2296, 2304, 
2307, 2312, 2313, 2316, 2319, 2320, 2322, 2325, 2328, 2331, 2334, 2336, 2340, 
2343, 2344, 2349, 2352, 2355, 2360, 2361, 2367, 2368, 2370, 2373, 2376, 2385, 
2394, 2400, 2403, 2406, 2421, 2430, 2432, 2439, 2457, 2472, 2484, 2496, 2511, 
2520, 2538, 2560, 2583, 2592, 2619, 2646, 2673, 2835, 2916, 3159, 3645} . 

Proof. The proof is computational. Using a heuristic algorithm described 
in |20^ pg. 34], we found examples of order 13 matrices with all 2173 deter- 
minants 0, 1 X 2^^ 2 X 2^^ . . . , 2172 x 2^2. The first "gap" was at 2173 x 2^2. 
We ran the Gram-finding program of ^with lower bound dmin = 2173 x 2^^. 
It produced 8321 candidate Gram matrices in 73 minutes. We then ran the 
decomposition program of ^ which found (in 48 seconds) that 1643 of the 
candidate Gram matrices decomposed, giving 130 distinct determinants in 
the range [2174, 3645]. These are listed in the statement of the theorem. □ 

Appendix: Proof of new bound ([9]) in Theorem [1] 

The proof is a generalisation Ehlich's proof [U] of the bound (I3D on the 
maximal determinant, which applies in the case n = 3 (mod 4). Ehlich's 
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proof shows the following. 

(1) The candidate principal minor of maximal determinant has non-diagonal 
elements equal to either —1 or 3. 

(2) It is a block matrix, which means that the non-diagonal 3s occur in 
square blocks along the diagonal. 

(3) In the case that the candidate principal minor is a candidate Gram 
matrix, that is, its size is n, the number of blocks is s, with u blocks of 
size [n/s\ and v blocks of size [n/s\ + 1, where s, u, and v are defined 
following ([3]). 

We generalise this to the case where the candidate principal minor contains 
a fixed principal submatrix M^. If such a candidate principal minor of 
maximal determinant is written as 

'Mr B 

then our result, assuming the hypothesis detM^ > (n — 3)detMr_i, is 
that A satisfies properties (1) and (2) above, and the submatrices of B 
corresponding to blocks of A consist of repeated columns. The generalisation 
of (3) depends on and is not unique in general. 

From now on, we take n = 3 (mod 4) and n > 3. Define 

— {Cffi\Crn — ^ij — ^ji^ Cm is pOS. def. , Cjj — Ti, 

Cij = n (mod 4:),i,j = 1 . . . m} . (17) 

and 

= {Em\Em ^ and the leading r x r submatrix of Em is M^}. (18) 

Define Cj^ and £'j^ (which may not be unique) by the conditions 

detC^ = max{detCm|Cm G ^m}, 
detE'j^ = maxjdet ii^m|-£'m G '^m\- 

The first thing Ehlich proves (Theorem 2.1) is that detCj^ > (n — 
3) det C^_i for 2 < m < n. To explain the use of this theorem, we first 
introduce a notation. If Cm G then define Cm be the matrix that results 
from replacing the last diagonal element of Cm by 3, i.e. Cm = (Qj) where 




3 if i = j = m 
Cij otherwise. 
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Expanding det by minors on its last row, we find 

dct C;„ - det C;^ = {n- 3) det C™_i < (n - 3) det C*,_^ (19) 

where Cm-i is the leading {m — 1) x (m — 1) submatrix of C*^. (Note that 
is the result of applying the tilde operation to C^.) The theorem then 
implies that detC^ > and therefore that is positive definite. This 
becomes important in later proofs when evaluating determinants that arise 
as the result of column operations. 

For the generalization to our case, we appear to need the extra condition 
det Mr > 0. This cannot be expected to hold in general. Consider for 
example, 

'11 7' 



M2 



7 11 



(20) 



for which det M2 < 0. For now, we leave it as a question for empirical 
study whether the condition holds often enough in practical searches for the 
following considerations to be useful. 

Theorem 6. Let 1 < r < m, let Mr G (tr, (ind let detM^ > 0. Then the 
set of elements Em G <tm for which det Em > is non-empty. 

Proof. We prove the theorem by induction on m. For the base case, m = r, 
the matrix Mr G €r satisfies det Mr > by assumption. Now assume that 
the theorem holds for all <Bk with r < k < m. We want to show that it holds 



for C: 



m+l • 



Let Em be an element of <£m for which det Em > 0, and write 



this element as 



Form the matrix 



E„ 



Em+l = 



Cm—1 
T 

7 



Cm-l 



7 
7^ 



7 
n 

7 
n 
3 



(21) 



(22) 



Subtracting column m from column m + l and expanding by minors on 
column m + 1 we find that det E'm+i = (^ ~ 3) det E„i + (n — 3) det Em- Both 
terms are positive, which means that det Em+i is positive, and therefore 
that Em+i is positive definite and hence an element of £m+i- By a similar 
computation det Em+i = (n — 3) det Em > 0- Therefore Em+i is a suitable 
element. □ 

Theorem 7. Let 1 <r <m, let Mr e ^r, and let detM^ > 0. Then 

det E*r^> {n- 3) det E*m_^. 
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Proof. When m = r + 1 we write 



Mr 



Cr-l 
T 

7 



and define 



r+l 



Cr-l 7 7 

^ n 3 
3 n 



7 



7 



(23) 



(24) 



Prom the proof of the previous theorem we know that -E^+i G C^+i and 
det Er+i > 0. Now det E*^^ > det Er+i = {n-S) det + (n - 3) det Mr > 
{n - 3) det M,. = (n - 3) det E;. . 

We now proceed by induction. Assume that det E!^ > (ri — 3) det E^_^. 
Write 

£^m-l 7 
T 

n 



El 



7 



(25) 



and define 



E, 



m+l 



Em-1 7 7 

n 3 
3 n 



7 
7 



T 



(26) 



Note that dot £'*„ 



Now det Era+i = (n — 3) det + (n — 3) det E* 
{n - 3) det Em-\ + det E*^ < (ra - 3) det E^_^ + det From the induction 
hypothesis, it follows that det E^ > 0, and so det Em+i > (n—S) det E^. □ 

This proof contains the proof of an important corollary: 

Corollary 8. Let 1 < r < m, let Mr G <tr, and let del Mr > 0. Then 
det^;; > 0. 

We now generalize Ehlich's Theorem 2.2. Again we need the assumption 
that det Mr > 0. 

Theorem 9. Let 1 < r < m, let Mr £ C and let det Mr > 0. Write 



El 



Mr B 

a 



where A = (aij) and B = (bij) satisfy the conditions in the definition of (Em- 
Then for i ^ j we have Oij = — 1 or 3. 

Proof. When m = r or r + 1 the statement is vacuously true. So we assume 
m > r + 2. Suppose there is an element a^j = c 7^ — 1 or 3 for i ^ j. Then 
|c| > 3. We may assume that the element is positioned so that i = m — 1, 
j = m, so that we may write 



El 



Em-2 a P 
T 

n c 

c n 



a 
/3 



T 
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By interchanging the last two rows and last two columns, if necessary, we 
may assume that 



det 



Em-2 OL 



a 



n 



< det 



Em-2 



We now claim that the matrix 



En 



Em-2 



f3 
n 3 
3 n 



has larger determinant than E"^, a contradiction. To establish the claim, 
evaluate both determinants: 



det El 



det En 



{n — 3) det 
(n — 3) det 



Em-2 OL 
T 

a n 

Em-2 P 

n 



+ det E^ 



+ det E„ 



By Corollary [51 -E,^ is positive definite. Symmetric row and column opera- 
tions do not affect positive definiteness, so we get 



detE* 



det 



Em-2 a (3 

.T 



< 



n 



a 

-Met 



n c 
c 3 



E, 



m-2 



det 



/3 



Em-2 



/3 a 3 
3 



a 



n-^ 



P' 



We evaluate det Em by subtracting column m from column m — 1 and doing 
expansion by minors on column m — 1 to obtain 



det Em = {n — 3) det 



Em-2 /3 
(3^ 3 



Since |c| > 3 we have det E^ < det Em and therefore det E^ < det Em- □ 

Now we want to generalize Ehlich's Theorem 2.3. First a useful lemma 
about block matrices. (See Ehlich's paper for the formal definition of block.) 

Lemma 10. A symmetric matrix A = (aij) with diagonal elements n is a 
block matrix if and only if its non-diagonal elements are all —1 or 3 and for 
any i ^ j such that aij = 3 the columns i and j differ only in their i^^ and 
j^^ elements. 
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Proof. If ^ is a block matrix, the statement is clearly true. For the converse, 
let be the position of one of the 3s of A. Define ii = j, 12 = i, and let 
{^2, is, . . . , ip} be the set of all indices h for which Uhj = 3. Let 2 < k < p. 



Then a 



3 means that the if^ element of column j is 3. Let 1 < i < p, 



£ k. Then since columns i£ and j agree in their i^^ element we have 



3 for all k 7^ 



For an index h ^ {ii, . . . ,ip} we have a^j = —1. But since columns j 
and i£, 1 < ( < p, agree in their h^^ element, we have Uhii = — 1 for all 
1 < i < p. Therefore the set of indices {ii, . . . ,ip} forms a block. Hence 
every one of the 3s in A lies in a block, and yl is a block matrix. □ 

Now for the generalization of Ehlich's Theorem 2.3. 
Theorem 11. Let 1 < r < m, let Mr G Cr, and let detM^ > 0. Write 



El 



Mr 



B 
A 



where A 



{uij ) and B = (bij ) satisfy the conditions in the definition of ^m, • 
If for some i 7^ j, aij = 3, then columns i and j of B are equal and columns 
i and j of A are equal except for their i^^ and j*^ elements. 

Proof. By Theorem [9] we know that the non-diagonal elements of A are — 1 
or 3. As before, the theorem is vacuously true ifm = r ox m = r + l. 
Assume m > r + 2 and let A have an element 3, say in position (m — 1, m). 
Write 

Bi 



El 



Mr 



T 



A; 



T 

«m-l 



Pm-1 

n 
3 



3 

n 



We assume, as we may (by swapping the last two rows and last two columns 
if necessary), that 



det 



■ Mr 

BJ 

Pm-l 



Bi 
Ai 



f3n 



n 



< det 



'Mr 

Bl 

Pi 



Bl 
Ai 



Am 

n 



Our goal is now to show that /?; 



m—l 



fim and a 



m—l 



am- Suppose that 



this is not the case. We claim that det Em > det E^ where 



E„ 



Mr 
Bf 

Hm 



Bl 
Ai 

T 

a 



I3m 


/3m 






n 


3 


3 


n 



Write 



det^! 



(n — 3) det 



Mr 
Bl 



a. 



Bl 
Ai 

m—l 



/3m— 1 
Om-l 

n 



+ det E* 
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and 



det En 



in 



3) det 



'Mr 



Bi 



+ det Er, 



n 



The first term on the right in det E^ is no larger than the first term on the 
right in det Em, and we will see that the second term of detE"^ is strictly 
smaller than the second term of det^^m- By subtracting row and column 
m of Em from row and column m — 1 of Em and expanding by minors on 
column m — 1 we find that 



det Em = (n — 3) det 



'Mr Bi p. 

Bf A 

A 



a. 



Or 



On the other hand, using Corollary [HI which implies that Em is positive 
definite, and evaluating the determinant as we did for deti^mj we find that 



det Em<{n- 3) det 



'Mr Bi Pm 

Bf Ai am 
3 



This follows because Um-i — otm and Pm-i — Pmi which together form the 
first m — 2 elements of column m — 1 in the expansion by minors, are not 
both zero. □ 

Corollary 12. The matrix A in Theorem[TJ\ is a block matrix. 

Proof. We have proved in Theorems [9] and [11] that both of the conditions 
needed in Lemma [TOl for ^ to be a block matrix hold. □ 

Our conclusion is that, when det Mr > 0, the maximal determinant 
completion Em of Mr takes a form where ^ is a block matrix with some 
number k of blocks whose sizes we will denote bi, b2, ■ ■ ■ , bk, and where 
B = . . . Bk\ with each of the matrices Bj a rank-1 matrix consisting 

of a column /3* repeated bj times. This establishes ([9]). 
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